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A COLOR TRANSFORM METHOD FOR THE MAPPING OF COLORS 



IN IMAGES 

FIELD OF THE INVENTION 

This invention relates to the field of digital image processing, and 
in particular to the field of color image transformation. 

BACKGROUND OF THE INVENTION 

In designing color image capture and reproduction systems, it is 
important to be able to render colors in an optimal manner such that they are most 
meaningful, appropriate, natural, and pleasing. Various modes of color 
reproduction are applicable in different color reproduction applications. For 
instance, a color image in a fine art publication may well be judged in terms of the 
accuracy of color appearance of the reproduction relative to the original artwork. 
Images intended for advertising may be judged in terms of the colorimetric 
accuracy of the reproduction of certain trademark colors against an aim. Color 
reproductions of analytical test charts such as the Macbeth™ color checker are 
judged relative to the spectral accuracy of the reproduction patches compared to 
the objects those patches represent. Pictorial images are generally judged against 
more arbitrary standards. Images used in commercial applications often have their 
chromas boosted, making them more appealing and attention grabbing. 
Professional portrait photographers will always print skin tones that flatter the 
subject rather than provide the most accurate rendition. Personal photographs, or 
snapshots, are frequently judged relative to a memory of how the original scene 
appeared. These memories are seldom "colorimetrically accurate" and are 
frequently influenced by color preferences of the customer, particularly for the so- 
called memory colors including sky, foliage and skin tones. 

A comprehensive discussion of color rendition can be found in R. 
W. G. Hunt, The Reproduction of Colour, 5 th Edition, , Fountain Press, pp. 223- 
242 (1 995). Hunt describes how color images can be reproduced in a range of 
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different ways, to achieve a number of different objectives. In each case, however, 
observers judge the color quality of that reproduction according to their intended 
use of the image. Hunt has identified six distinct modes of color reproduction that 
cover all applications of color reproduction from entertainment to scientific. 
5 • The most demanding mode of color reproduction is "spectral reproduction". 
This is where the spectral reflectance (or transmittance) of the reproduction 
matches that of the original. In this case the reproduction and the original will 
match in appearance regardless of changes in illuminant for any observer. 
Spectral color reproduction is seldom achieved in practice and is not 
10 commercially viable as a means of image reproduction. 

• In "colorimetric color reproduction" the chromaticities and relative luminances 
of the original and reproduction match for a defined viewing illuminant and a 
defined standard observer. Since color appearance is not independent of 
viewing illuminant intensity, colorimetric reproductions do not match 

15 originals in color appearance for large intensity changes. 

• "Exact color reproduction" occurs when the conditions for colorimetric color 
reproduction are met and, the absolute luminances of the reproduction and 
original match. The original and reproduction will match in appearance for a 
standard observer under identical conditions of visual system adaptation. 

20 • If a reproduction is to be viewed under different conditions of adaptation than 
the original then a color appearance match can only be achieved if adaptation 
factors are considered and accounted for in the mode of reproduction. This is 
the case with "equivalent color reproduction". This is very difficult to achieve 
in practice because the colorfulness of objects seen under bright daylight 

25 usually cannot be reproduced under artificial illuminant viewing conditions. 

• In "corresponding color reproduction" the objective is to reproduce an original 
scene as it would appear if it were viewed under the reproduction viewing 
conditions. 

• The final mode of color reproduction is "preferred color reproduction". In this 
30 mode the reproduction colors are rendered to match the preference of the 
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observer. These preferences will tend to vary from observer to observer but 
there are general, quantifiable preferences that exist across most observers that 
can be included in a color reproduction. 

In addition to the Hunt book, there are a number of publications in 
5 the technical literature that refer to the importance of preferred colors and concept 
of key memory colors in the art of rendering natural images. For example, C. J. 
Bartleson, "Memory Colors of Familiar Objects," Journal of the Optical Society of 
America, 50, pp. 73-77, (1960); P. Siple, and R. M. Springer, "Memory and 
Preference for the Colors of Objects," Perception and Psychophysics, 34, pp. 363- 

10 370, (1983); S. Sanders, "Color Preferences for Natural Objects," Illuminating 
Engineering, 54, p. 452, (1959); and R. W. G. Hunt, I. T. Pitt, and L. M. Winter, 
"The Preferred Reproduction of Blue Sky, Green Grass and Caucasian Skin in 
Colour Photography," Journal of Photographic Science," 22, pp. 144-150, (1974). 
It is evident from this literature that, for some objects whose colors are well- 

15 known, preferred color reproduction may be advantageous, wherein departures 
from equality of appearance (whether at equal or at different absolute luminance 
levels) may be required in order to achieve a more pleasing rendition. 

As a consequence, imaging and photographic companies have 
intuitively understood the benefits of preferred color rendition for many years and 

20 have attempted to achieve some measure of customer preference through careful 
manipulation of the characteristics, including tone scale, interimage and spectral 
sensitivity, of the photographic system. In contemporary imaging systems, 
preferred color rendering is often accomplished through the use of some form of 
preferred color mapping. For example, U.S. Patent No. 5,583,666 describes a 

25 method for transforming an input color space to an output color space using a 
transform. In particular, a computer graphics morphing technique is described 
wherein the explicit constraints are comprised of points residing on the gamut 
boundary of the input and output color spaces. Although this method produces a 
smooth output rendition, it is limited in terms of the constraints it can impose on 

30 the color space transformation. An arbitrary point in the color space cannot be 



moved to another arbitrary position in color space. A group of patents issued to 
Buhr et al. (U.S. Patent Nos. 5,528,330; 5,447 811; 5,390,036; and 5,300,381) 
describe color image reproduction of scenes with preferential tone mapping for 
optimal tone reproduction in color photographs. In this series of patents, the 
image reproduction is modified by a scene parameter transformation which, when 
taken in conjunction with untransformed characteristics of the image reproduction 
system and method, results in a reproduced tone mapping having instantaneous 
gamma values with a prescribed set of properties. This produces a reproduction 
having preferred visual characteristics with respect to tones, but does not address 
the issues of preferred color nor does it provide any method of generating a 
preferred color reproduction. Such tonal mappings, when applied to color data 
represented in an additive RGB type of color space, also result in chroma 
modifications. These chroma modifications are coupled to the tonal mapping and 
achieve chroma increases only as a consequence of luminance contrast increases. 
There is no provision in such methods for independent control of luminance and 
chrominance mappings. Furthermore tonal mappings such as these introduce 
uncontrolled hue shifts for most colors whenever the tonal mapping deviates from 
linearity Another limitation of tonal mappings is that there is no ability to 
selectively apply the transform to limited regions of the color space. 

As mentioned above, in contemporary imaging systems, preferred 
color rendering is often accomplished through the use of some form of preferred 
color mapping that is typically achieved through limited, slow and inflexible 
means. These means include, but are not limited to, modification of tonescales, 
modifications of selected colors, change of dyes or colorants, or manual 
manipulation of digital images using products such as Adobe Photoshop®. 
Because the perception of the light received by the eye and interpreted as a natural 
image is a very complex process, the subtle color and tonescale changes inherent 
in natural images are not well accommodated by simple transformations. As a 
result, a myriad of artifacts and unnatural appearing problems occur. These 
problems can include transitions between colors across gradients of hue, chroma, 



-5- 

or lightness that are not as smooth or continuous as they appear in the natural 
scene. These transitions may produce artifacts or discontinuities in the image. In 
additions the calculations necessary to compute the required transforms are often 
complex and may require dedicated computational resources and time. The time 
5 required for accomplishing the calculations often limits the applicability of the 
methods because they cannot be done in real time as images are physically 
produced and as a result must be done offline or else a substantial sacrifice in 
productivity will result. 

What is needed is a completely new algorithm that enables colors 

10 to be transformed to produce a preferred color mapping, preferably by moving 
colors to or toward preferred positions in a color space. Ideally, when natural 
images are processed, gradations in color or between colors should appear as 
smooth or sharp in the modified images as they did in the original. Specifically, 
continuous transitions should be smooth and continuous and should not produce 

15 artifacts, discontinuities or contours. In addition, the overall impression of the 

composition of the image should be such that the rendered image is more pleasing 
than prior to treatment with the algorithm. 

SUMMARY OF THE INVENTION 

20 The present invention is directed to overcoming one or more of the 

problems set forth above. Briefly summarized, according to one aspect of the 
present invention, the invention resides in a method for transforming a file of 
digital color data representing a color image into a new file of digital color data 
where one or more colors have been transformed to one or more new color 

25 locations where their reproduction is known to be preferred. The digital color data 
is provided in a multi-dimensional color space where the preferred color locations 
in the color space are designated as color magnets. The color space distance is 
then calculated between the color locations of the digital color data in the color 
space and the color magnets, wherein each color magnet has a predetermined 

30 region of influence. A particular activity is prescribed for each color magnet that 
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affects color locations in the color space within the region of influence of each 
color magnet. Then, the digital color data is mapped to new locations in the multi- 
dimensional color space as a function of the color space distance and the selected 
activity, wherein the degree or strength of activity is a function of the color space 
5 distance or direction in color space. More specifically, the aforementioned 

activities includes such activities as attraction, repulsion, shielding and dragging. 

The advantageous features of this invention are realized when 
natural images are processed practicing this invention. Gradations in color or 
between colors appear as smooth or sharp in the rendered images as they did in the 

10 original image. Continuous transitions are smooth and continuous and do not 
produce artifacts, discontinuities or contours. In addition, the overall impression 
of the composition of the image is such that the rendered image is more pleasing 
than prior to treatment with the algorithm. In related technical advantages, the 
time required to process an image is minimized because the transformation may 

15 be generated in a separate, off-line process and used to calculate a three 

dimensional lookup table that is subsequently used to apply the transformation to 
images. This can be done because transformations can be constructed that are 
universally applicable to all natural images, not just a small subclass of images. 
Thus in operational use, the required calculations are extremely rapid because they 

20 only require the application of a single three-dimensional look up table to the 
pixels in the image. The transformation can be applied to images in a high 
volume digital photofinishing application in real time. 

These and other aspects, objects, features and advantages of the 
present invention will be more clearly understood and appreciated from a review 

25 of the following detailed description of the preferred embodiments and appended 
claims, and by reference to the accompanying drawings. 



30 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic illustration of the elements controlling the 
behavior of a color magnet. 
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FIG. 2 is a diagram of the process for transforming digital color 
data in accordance with the invention. 

FIGS. 3 A and 3B together form a diagram of the process for 
calculating the color magnets algorithm. 
5 FIGS. 4A and B show examples of the effect of an attractive 

magnet that affects the hue and lightness, as shown on CIELab b* versus a* and 
L* versus C* diagrams, respectively. The colors are indicated by stars before 
application of the color magnets algorithm and by triangles after application of the 
color magnets algorithm. 

10 FIGS. 5 A and B show examples of the effect of a repulsive magnet 

that affects the hue and lightness of green colors having mid-levels of lightness, as 
shown on CIELab b* versus a* and L* versus C* diagrams, respectively. The 
colors are indicated by stars before application of the color magnets algorithm and 
by triangles after application of the color magnets algorithm. 

15 FIGS. 6 A and 6B show examples of the effect of a dragnet that 

changes green colors by increasing chroma and lightness by 10 and decreasing hue 
by 20, as shown on CIELab b* versus a* and L* versus C* diagrams, respectively. 
The colors are indicated by stars before application of the color magnets algorithm 
and by triangles after application of the color magnets algorithm. 

20 FIGS. 7 A and B show examples of the effect of a shield that 

protects skin colors (L* « 50, a* « 25, b* « 25) acting on a magnet that modifies 
chroma and lightness of all hues, as shown on CIELab b* versus a* and L* versus 
C* diagrams, respectively. The colors are indicated by stars before application of 
the color magnets algorithm and by triangles after application of the color magnets 

25 algorithm. 

FIG. 8 is a perspective diagram of a computer system for 
implementing the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

Because digital image processing algorithms and systems 
employing color space transformations are well known, the present description 
will be directed in particular to attributes forming part of, or cooperating more 
5 directly with, a color space transformation in accordance with the present 

invention. Attributes not specifically shown or described herein may be selected 
from those known in the art. In the following description, a preferred embodiment 
of the present invention would ordinarily be implemented as software in a 
computer program. Those skilled in the art will readily recognize that the 

10 equivalent of such software may also be constructed in hardware. Given the 
method as described according to the invention in the following materials, 
software not specifically shown or suggested herein that would be useful for 
implementation of the invention is conventional and within the ordinary skill in 
such arts. Moreover, the computer program may be stored in a computer readable 

15 storage medium, which may comprise, for example; magnetic storage media such 
as a magnetic disk (such as a floppy disk) or magnetic tape; optical storage media 
such as an optical disc, optical tape, or machine readable bar code; solid state 
electronic storage devices such as random access memory (RAM), or read only 
memory (ROM); or any other physical device or medium employed to store a 

20 computer program. 

This invention relates to a new method that enables colors in an 
image to be transformed to produce a new color mapping for producing images. It 
is generally used in the field of digital image processing to modify the colors in a 
rendered image, or in a digital image in an intermediate stage of processing, in a 

25 way that those viewing the images perceive the color to be more preferred. This is 
accomplished through an algorithm that transforms the color space by attracting, 
or otherwise moving, colors to or toward preferred positions in a color space in a 
smooth and naturally appearing manner. The transformation is such that the 
mapping of colors is accomplished in a smooth and continuous fashion that does 

30 not produce artifacts, contours or discontinuities in the image and maintains the 
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appearance of the image as a natural image. Additionally, in certain specific 
applications, it is possible to dramatically, and intentionally, alter the appearance 
of an image using color magnets such that the altered image no longer looks like a 
natural image. 

5 The attraction of colors to or toward preferred positions in a color 

space in a smooth and naturally appearing manner is obtained by an algorithm that 
utilizes features herein characterized as "color magnets". The color magnets 
transformations described herein are contained in an algorithm that provides a 
smooth, artifact free means of implementing preferred color transforms in a color 

10 reproduction system. "Color magnets", as used in this disclosure, refers to an 

algorithm designed to produce color transforms through a mathematical transform 
as described herein. The term "color magnets" is used herein in the sense of an 
approximate analogy between the physical effects of attraction and repulsion that 
physical magnets have on magnetic materials and the effect that the 

15 transformation achieved by this invention has on values in a color space to or 
toward or away from a given point in that color space. It is anticipated that these 
transforms will typically be used to produce a preferred color mapping for an 
image or group of images. 

In practice, this invention is embodied in an algorithm that allows 

20 the user to create a transform that modifies the colors in an image. While it would 
be feasible to process the digital information representing the colors in an image 
through the algorithm a pixel at a time, this could be a slow process. 
Consequently, the preferred embodiment comprises using the algorithm to 
produce a multi-dimensional (typically three-dimensional) lookup table of 

25 numbers for effecting the transformation. The digital information representing the 
colors in an image are then processed through the lookup table to produce a new 
set of digital information representing the desired colors. The algorithm typically 
works in the CIELab/CIELCh color space but can also be used in any other color 
space, such as CIELUV color space. The advantage of CIELab/CIELCh is that it 

30 is an approximately perceptually uniform space, making the results of the 
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transform easier to predict. In fact, any multi-dimensional color space may be 
used wherein the dimensions correspond to perceptual attributes of color for 
human observers, including one or more of lightness, brightness, chroma, 
colorfulness, saturation and hue. A detailed description of these color spaces can 
5 be found in Color Appearance Models by Mark D. Fairchild, Addison- Wesley, 
(1997). 

As expressed in Figure 1, the behavior 10 of a color magnet, and 
the color transformation it produces, is controlled by two factors: The region of 
influence 12 of the magnet, that is, the region of color space that the magnet 

10 influences and, secondly, the effect 14 that the magnet has on colors within its 
region of influence. While the functional behavior of a color magnet may be 
defined such that the region of influence has a definite boundary, it should be 
understood that the region of influence of the magnets is preferably unbounded in 
extent given the functional behavior defined below. In this case, consequently, a 

15 region of influence is defined as the region in which the "magnetic effect" is 
greater than a given threshold that would typically cause a visually perceptual 
change in a color. The region of influence of the magnet is in turn controlled by 
two factors: The location of the center 16 of the magnet and the way that the color 
space distance calculation 18 is defined for the magnet. The effect that the magnet 

20 has on colors within its region of influence is in turn controlled by three factors: 
The type of magnetic behavior 20 ascribed to the magnet (i.e. attract, repel, shield 
or drag) , a function 22 that describes how magnetic effect changes with color 
space distance (as it is defined for that particular magnet) and the strength factors 
24 that allow additional control over the direction of color change within the color 

25 space. 

The overall method for transforming image color using a color 
magnets transform, in the form of a multi-dimensional lookup table, in accordance 
with the invention is shown in Figure 2. Initially, in step 100 a color space is 
chosen; as mentioned above, the preferred color space is CIELab/CIELCh color 
30 space. Then in a step 110, certain colors are specified that represent the centers of 



- 11 - 

regions of color space that are to be modified. If an attractive magnet is to be 
specified then this center represents a preferred color position. It may, for 
example, represent a significant memory color such as skin color, blue sky or 
green foliage. (An attractive magnet may be used to modify other colors that 

5 would not ordinarily be considered significant memory colors; for example, a 
color magnet may be specified to lower the lightness of saturated reds to bring 
them inside the gamut of photographic paper.) In the case of a repulsive magnet 
then the center would represent an undesirable color, or a color around which 
color differentiation is to be increased. If a shield is to be specified then the color 

10 center represents the central color of a region that is to be protected from change. 
An example of this might be an average Caucasian flesh color. In the case of a 
dragnet the color center represents the center of a region of color space that we 
wish to modify. The color magnets are then assigned coordinate locations in step 
120 that match the location of these preferred colors. Since the color magnets 

15 exhibit different field characteristics (i.e., attract, repel, shield or drag) that act 
upon nearby colors, the desired behavior of the color magnets is specified in step 
130. Attractive and repulsive type color magnets generate a field-like effect that 
encompasses and acts upon adjacent colors in the color space. Shield type color 
magnets exert a protective field on adjacent colors with the extent of protection 

20 falling off as distance from the magnet center increases. Dragnets can be pictured 
as centers to which adjacent colors are linked by anisotropic elastic bonds. The 
closer a color is to the center of the dragnet, the more strongly it is bound to the 
dragnet. Colors are also considered to be bound to their current locations by 
similar elastic bonds. The dragnet center is then moved to a new location in the 

25 color space, pulling adjacent colors along with it. Colors closest to the dragnet 
center, being more strongly bound to it, are dragged closer to the new location 
than colors that were further from the dragnet center. A regular sampling of colors 
within the chosen color space is generated in step 140. This is generally achieved 
by sampling values (uniformly or otherwise) along each of the independent 

30 dimensions of the color space and constructing all combinations (a full factorial) 
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of these sampled values to create a grid of fully specified colors within the color 
space. The grid of colors is mapped through the color magnets algorithm in step 
150, resulting in a set of transformed colors within the color space. This set of 
colors, together with the input set of colors can be used to fully define and 

5 construct a multi-dimensional lookup table. In order to apply the color magnets 
transform to an image it is only necessary to convert the image to the color space 
chosen in step 100 and to map the image through the multi-dimensional lookup 
table previously constructed (step 170). 

The procedure for using the color magnets algorithm is 

10 shown in figures 3A and 3B. In step 200 the locations and behaviors of the color 
magnets are defined. The behavior of color magnets has been discussed above. 
Turning now to the location of the center of each magnet, color magnets are 
assigned a center point location in the working color space. In the CIELab/ 
CIELCh color space for example, the location of the color magnet center is 

15 described by a set of three numbers - either L m a m b m or L m C m h m representing 
either L*, a* and b* or L*, C* and h*, where L* represents lightness, a* 
represents a red-green chromaticity axis, b* represents a yellow-blue chromaticity 
axis, C* represents chroma, and h* represents hue. Because of the anisotropic 
behavior allowed to magnets, it can sometimes be misleading to describe magnet 

20 location as a single point in color space. Depending on the way that the color 
space distance calculation is defined, it can sometimes be better to visualize a 
magnet as a line, a plane or a cylinder rather than a single point, as will be further 
elucidated in the material on distance calculation below. 

With regard to the way that the color space distance calculation is 

25 defined for the magnet, it should be noted that a consequence of the anisotropy of 
a color space is that color magnets need to be able to display anisotropic behavior. 
In all color spaces the three (or more) dimensions of the color space represent 
different properties of a color. An example of this is the lightness, chroma and hue 
system. This can be contrasted with a three dimensional geometric space in which 

30 all the dimensions represent length. Thus, in the geometric space we expect the 



- 13- 

same behavior no matter which direction we travel within the space (isotropic 
behavior). In the color space however, if we move along the lightness dimension 
we observe color to change in lightness, while if we move along the hue 
dimension we would see colors change from red to orange to yellow etc at 

5 constant lightness and chroma. Accordingly, if we move a color a fixed distance 
higher in the lightness dimension it will become lighter, but if we were to move 
the same distance in the hue dimension it may change from red to yellow 
(anisotropic behavior). 

Turning now to magnet behavior, as stated above in relation to 

10 Figure 1 , the effect that the magnet has on colors within its region of influence is 
controlled by three factors: The type of magnetic behavior ascribed to the magnet 
(i.e. attract, repel, shield or drag), a function that describes how magnetic effect 
changes with color space distance (as it is defined for that particular magnet) and 
the strength factors that allow additional control over the direction of color change 

1 5 within the color space. Four types of magnet behavior have been defined in the 
color magnet algorithm: 

• Attraction - the magnet attracts colors to or towards itself. 

• Repulsion - the magnet repels colors from itself 

• Dragging - the magnet itself moves in the color space, dragging nearby 
20 colors along with it. 

• Shielding - the effect of the magnet is to shield nearby colors from the 
effects of other color magnets. 

These behaviors are shown graphically in Figures 4 to 7 for each of the behaviors, 
25 respectively, in CIELab a* versus b* space and L* versus C* space. 

Referring again to Figure 3, in step 210 the distances between each 
color and each magnet is calculated. Anisotropy in the calculation of color space 
distance is introduced by allowing separate weightings for the three dimensions of 
the color space. Thus, in the CIELab/CIELCh color space the distance, d c m , of a 
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particular color at location L c a c b c from a magnet at location L m a m b m is calculated 
as follows: 





Aa* cm = a m —a c 
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It is apparent from equation 8 above that the weights w K , w Cm and w Hm can be 
used to control the anisotropy in the calculation of color space distance. Each 

15 magnet has its own unique set of weights w Lm , w Cm and w Hm and can therefore 
exhibit different anisotropy from other magnets. As an example, consider a 
magnet for which w L is set to zero. This is a magnet that is insensitive to 
lightness. The shape of this magnet could therefore be considered as a straight line 
parallel to the L* axis. The distance to colors in the color space therefore depends 

20 only on the chroma and hue differences between the magnet and the color in 

question. Another example is a magnet for which both w K and w Hm are zero. The 
magnet is therefore insensitive to both lightness and hue. This magnet could be 
visualized in CIELab space as a cylinder, parallel to the L* axis and with a radius 
equal to the chroma of the magnet's center. 

25 Step 220 is the calculation of the magnetic effect field of each 

color magnet, shield and dragnet on all colors in the image or color set. The effect 
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field of a color magnet, as a function of distance from the color magnet center, can 
be described using any one of a variety of functions. The practical choice of such a 
function is, however, constrained by a need for desirable characteristics for a color 
magnet mapping. Desirable characteristics include: 

• Mappings are smooth and continuous and, when applied to images, do 
not result in abrupt transitions or contours. 

• Magnet behavior is predictable and reasonable. That is, magnet effect 
field is strongest at the location of the magnet center and diminishes 
with distance. At sufficiently large distances the magnet should have 
no effect field. 

In order to achieve these characteristics, a mathematical function describing the 
effect field of a color magnet as a function of distance should preferably have the 
following properties: 

• The function has a maximum at a distance of zero. 

• The function decreases smoothly and continuously as distance 
increases. 

• The function asymptotically approaches zero as distance approaches 
infinity. 

• The function is always non-negative. 

• The function has a slope of zero at zero distance. 

While a variety of functions may be used that at least approximate the desirable 
properties mentioned above, the initial version of color magnets uses either of the 
two following functions, both having the properties listed above, to describe the 
magnet effect field, q c m at color location c resulting from color magnet m , as a 
function of distance, d c m . The first of these is a pseudo-Gaussian type of function 
(equation [9]) and the second is an inverse multi-quadric function (equation [10]): 
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= exp |_^L| [9] 



[10] 



10/? 



In equations [9] and [10], a is a parameter that controls the slope and p is a 
parameter that controls the width of the effect field function. The use of a factor of 
10 p in the denominator of [10] is arbitrary and is chosen to make the half width 
of [10] similar to that of [9]. 

At this point (step 230) in the algorithm it is necessary to separate 
the shields from the other magnets and dragnets. This is because of their 
fundamentally different types of behavior - magnets and dragnets act to move 
colors within the color space while shields act to prevent movement of colors by 
attenuating the effects of magnets and dragnets. 

Step 240 is the calculation of the effect field of each magnet or 
dragnet on every other magnet or dragnet. This calculation is entirely analogous to 
that summarized in equations [9] and [10] and is given by equations [1 1] and [12] 
for the two example effect field functions. 

~ d - ' [11] 
[12] 



1 



\0p m 



In these equations, q n is the magnetic effect field of magnet m x on magnet m 2 , 
d m m is the color space distance from magnet m 1 to magnet m 2 calculated using 
the distance anisotropy weightings assigned to magnet m l , a mi is the slope 
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parameter assigned to magnet m x and p mi is the width parameter assigned to 
magnet m l . 

In order to ensure smooth and consistent movement of colors 
within the color space when colors are being influenced simultaneously by 

5 multiple magnets and dragnets we must perform a normalization of the effect 
fields. This is accomplished in step 250. In general, there will be a set of j 
magnets all simultaneously acting on all k colors in a color set. These j magnets 
comprise a total of// attractive and repulsive magnets and tj dragnets. It is 
desirable that colors that are exactly at the location of an attractive magnet are not 

1 o moved away by the influence of other magnets. This problem is analogous to a 
multi-dimensional scattered data interpolation problem where it is desirable to 
reproduce data points exactly while interpolating smoothly between them. One 
simple approach to this problem is the method of inverse distance interpolation as 
discussed in Mathematics of Computation , Volume 38, pp 181 - 200, (1982) by 

15 Richard Franke. Other interpolation methods described in this reference would be 
similarly applicable. 

Following this method, interpolation for attractive color magnets is 
implemented as follows. The magnetic effect field of each magnet on each color is 
represented by matrix Q c m and the magnetic effect field of each magnet on each 

20 other magnet by matrix P m m : 
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(Note: Because each magnet can display unique anisotropy, the matrix P m m is not 
generally symmetric.) The normalized attraction matrix N c m is then calculated as 
follows: 

The normalized attraction matrix has k rows and j columns as follows: 



[16] 



In step 260, the total shielding, from the combined effect of all shields, on each 
color is calculated. The shielding behavior of a color to a color magnet, as a 
function of color space distance between the color magnet center and the color, 
can be described by using a matrix. If there are i shields simultaneously acting on 
k colors in a color set or image, then the shielding effect field on each color by 
each shield can be represented by the matrix R s m . 
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We now calculate the total shielding for each color, c , in the lightness, chroma 
and hue dimensions. In the matrix Total R LCHc , total lightness shielding is found in 
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column 1 , total chroma shielding is in column 2 and total hue shielding is in 
column 3: 









Total d _ 

LCH C 
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The constants A Ca and ^ are the strength values of shield a for the 
lightness, chroma and hue color dimensions respectively. 

In step 270 of the method the 'force' of each magnet, accounting for 
shielding, on each color is calculated. In equation [20] the n terms are from the 
normalized attraction matrix (equation [16]) and the r terms are from the total 
shielding matrix (equation [19]): 













n Cl , m fi- r i) ^ m fi-r 2 ) ■ 
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Steps 280, 290 and 300 of the method describe the calculation of the change in 
lightness hue and chroma of each color due to the action of all of the magnets. The 
calculations here are slightly different for magnets and dragnets, so in step 280 the 
dragnets are sorted from the attractive and repulsive magnets. 

Dealing with attractive and repulsive magnets only in step 290 the 
change in lightness, and chroma and hue of each color due to the combined action 



-20- 

of all of the magnets, allowing for shielding is calculated in the following 
equation [21]: 



magnets MCH c 



ILsaAJ^K^ 1Lg« A cJ^A c t>»« Zs^Jc^U 

|> 8 ^/^U 2>^c^AC; A ±g a A Ha f Cl , ma Mll ma 
ts a AJ Ct , ma K^ ls a AJ Ck , m ACi ma ± Sa A Ha f Ci , ma AHl ma 



In equation [21], /u is the total number of attractive and repulsive magnets 
and g a takes the value +1 if magnet oris an attractive magnet and -1 if magnet a 
is a repulsive magnet. The constants A La , A Ca and A Ha are the strength values of 
magnet a for the lightness, chroma and hue color dimensions respectively. The 
changes in lightness are in column 1 of the matrix while changes in hue and 
chroma can be found in columns 2 and 3 respectively. 

In step 300 the change in lightness, chroma and hue of each color 
due to the combined action of all of the dragnets, allowing for shielding is 
calculated as follows: 



dragneis ALCH c 



2X,^k ifc 2 , m Ac* ma |x„ a M/; 
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In equation [22], rj is the total number of dragnets. The constants AL* ma , AC* a 
20 and AH * are the shift (or drag) distances for dragnet a in the lightness, chroma 
and hue color dimensions respectively. 
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The transformed colors are now calculated in step 310 according to 
equation [23], where, if the original colors are represented as LCH , then the new 
colors LCH' are : 

LCH' = LCH+ masnets ALCH+ dra8nets ALCH [23] 

It should be remembered that equation [23] represents vector addition and that hue 
is a periodic dimension. 

While the overall methodology of the invention is described above, 
the invention can be embodied in any number of different types of systems and 
executed in any number of different ways, as would be known by one ordinarily 
skilled in the art. For example, as illustrated in Figure 8, a typical hardware 
configuration of an information handling/computer system in accordance with the 
invention preferably has at least one processor or central processing unit (CPU) 
400. The CPU 400 is interconnected via a system bus 410 to a random access 
memory (RAM) 420, a read-only memory (ROM) 430, an input/output (I/O) 
adapter 440 (for connecting peripheral devices such as disk units 450 and tape 
drives 460 to the bus 410), a communication adapter 470 (for connecting an 
information handling system to a data processing network), a user interface 
adapter 480 (for connecting peripherals 490, 500, 510 such as a keyboard, mouse, 
digital image input unit, microphone, speaker and/or other user interface device to 
the bus 410), a printer 520 and a display adapter 530 (for connecting the bus 410 
to a display device 540). The invention could be implemented using the structure 
shown in Figure 8 by including the inventive method within a computer program 
stored on the storage device 450. Such a computer program would act on an 
image frame supplied through the interface units 490, 500, 5 10 or through the 
network connection 470. The system would then automatically produce the 
desired color space transformation, which would provide the improved images to 
the display 540, to the printer 520 or back to the network 470. In the preferred 
embodiment, the coefficients for the transformations would be predetermined 
(precalculated) for given magnets at given preferred locations and stored in look 



-22- 

up tables in memory such as the disk drive 450. Then, the actual conversion of the 
digital color data would involve accessing the look up tables to determine the 
transformed code value for each input code value. 

When natural images are processed practicing this invention, 
gradations in color or between colors appear smooth or sharp in the rendered 
images as they did in the original image. Specifically continuous transitions are 
smooth and continuous and do not produce artifacts, discontinuities or contours. 
In addition, the overall impression of the composition of the image is such that the 
rendered image is more pleasing than prior to treatment with the algorithm. The 
time required to process an image is minimized because the transformation is 
calculated offline. This can be done because the transformation is universally 
applicable to all natural images, not just a small subclass of images. Thus in 
operational use, the required calculations are extremely rapid because they only 
require the application of a single three-dimensional look up table to the pixels in 
the image. The transformation can be applied to images in a high volume digital 
photofmishing application in real time. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the spirit and scope of the invention. 
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WHAT IS CLAIMED IS: 
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1 . A method of transforming a file of digital color data 
representing a color image to a new file of digital color data where one or more 
colors have been transformed to one or more new color locations where their 
reproduction is known to be preferred, said method comprising the steps of: 

(a) providing the digital color data in a multi-dimensional color 

space; 

(b) specifying one or more preferred color locations in the color 
space as one or more color magnets, wherein each color magnet has a 
predetermined region of influence; 

(c) calculating color space distance between one or more color 
locations of the digital color data in the color space and one or more of the color 
magnets; 

(d) prescribing a particular activity for each color magnet that 
affects color locations in the color space within the region of influence of each 
color magnet; and 

(e) mapping the digital color data to or toward new locations in 
the multi-dimensional color space as a function of the color space distance and the 
activity, wherein the degree or strength of activity is a function of at least the color 
space distance or direction in color space. 

2. The method as claimed in claim 1 wherein said activity 
specified in step (d) includes at least one activity selected from the group 
including attraction, repulsion, shielding and dragging. 

3 . The method as claimed in claim 2 wherein in the activity of 
attraction the color magnet attracts colors to or toward itself. 
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4. The method as claimed in claim 2 wherein in the activity of 
repulsion the color magnet repels colors from itself. 



5 . The method as claimed in claim 2 wherein in the activity of 
shielding the color magnet shields nearby colors from the effects of other color 
magnets. 

6. The method as claimed in claim 2 wherein in the activity of 
dragging the color magnet itself moves in the color space, dragging nearby colors 
along with it in a prescribed and smoothly varying manner. 

7. The method as claimed in claim 1 wherein the preferred 
color location is selected from the group including a point, line, plane, or cylinder 
in the color space. 

8. The method as claimed in claim 1 wherein the preferred 
color location is known to a viewer of the color image to be preferably reproduced 
in a particular accurate colorimetric manner relative to other renderings of that 
color. 

9. The method as claimed in claim 8 wherein the preferred 
color location includes at least one of sky, foliage and skin tones. 

10. The method as claimed in claim 1 wherein the multi- 
dimensional color space is CIELab/ CIELCh color space. 

1 1 . The method as claimed in claim 1 wherein the multi- 
dimensional color space is CIELUV color space 
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12. The method as claimed in claim 1 wherein the multi- 
dimensional color space is any color space wherein the dimensions correspond to 
perceptual attributes of color for human observers, including one or more of 
lightness, brightness, chroma, colorfulness, saturation and hue. 

13. The method as claimed in claim 1 wherein step (c) 
introduces anisotropic behavior into the calculation of color space distance by 
allowing for separate weightings in one or more of the dimensions of the multi- 
dimensional color space. 

14. The method as claimed in claim 1 wherein step (e) 
introduces anisotropic behavior into the mapping by allowing for separate degrees 
or strengths of activity in one or more of the dimensions of the multi-dimensional 
color space. 

15. A computer program product for transforming a file of 
digital color data representing a color image to a new file of digital color data 
comprising: a computer readable storage medium having a computer program 
stored thereon for performing the steps of: 

(a) providing the digital color data in a multi-dimensional color 

space; 

(b) specifying one or more preferred color locations in the color 
space as one or more color magnets, wherein each color magnet has a 
predetermined region of influence; 

(c) calculating color space distance between one or more color 
locations of the digital color data in the color space and one or more of the color 
magnets; 

(d) prescribing a particular activity for each color magnet that 
affects color locations in the color space within the region of influence of each 
color magnet; and 
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(e) mapping the digital color data to new locations in the multi- 
dimensional color space as a function of the color space distance and the activity, 
wherein the degree or strength of activity is a function of the color space distance 
or direction in color space, thereby transforming the digital color data to or toward 
new color locations where their reproduction is known to be preferred. 

16. The computer program product as claimed in claim 1 5 
wherein said activity specified in step (d) includes at least one activity selected 
from the group including attraction, repulsion, shielding and dragging. 

17. The computer program product as claimed in claim 1 6 
wherein in the activity of attraction the color magnet attracts colors to or toward 
itself. 

1 8 . The computer program product as claimed in claim 1 6 
wherein in the activity of repulsion the color magnet repels colors from itself. 

1 9. The computer program product as claimed in claim 1 6 
wherein in the activity of shielding the color magnet shields nearby colors from 
the effects of other color magnets. 

20. The computer program product as claimed in claim 1 6 
wherein in the activity of dragging the color magnet itself moves in the color 
space, dragging nearby colors along with it in a prescribed and smoothly varying 
manner. 



21 . The computer program product as claimed in claim 1 5 
wherein the preferred color location is selected from the group including a point, 
line, plane, or cylinder in the color space. 
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22. The computer program product as claimed in claim 1 5 
wherein the preferred color location is known to a viewer of the color image to be 
preferably reproduced in a particular accurate manner relative to other renderings 
of that color. 

23. The computer program product as claimed in claim 22 
wherein the preferred color location includes at least one of sky, foliage and skin 
tones. 

24. The computer program product as claimed in claim 1 5 
wherein the multi-dimensional color space is CIELab/ CIELCh color space. 

25 . The computer program product as claimed in claim 1 5 
wherein the multi-dimensional color space is CIELUV color space 

26. The computer program product as claimed in claim 15 
wherein the multi-dimensional color space is any color space wherein the 
dimensions correspond to perceptual attributes of color for human observers, 
including one or more of lightness, brightness, chroma, colorfulness, saturation 
and hue. 

27. The computer program product as claimed in claim 1 5 
wherein step (c) introduces anisotropic behavior into the calculation of color space 
distance by allowing for separate weightings in one or more of the dimensions of 
the multi-dimensional color space. 

28. The computer program product as claimed in claim 1 5 
wherein step (e) introduces anisotropic behavior into the mapping by allowing for 
separate degrees (strengths) of activity in one or more of the dimensions of the 
multi-dimensional color space. 
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29. A system for transforming a file of digital color data 
representing a color image to a new file of digital color data, said system 
comprising: 

means for providing the digital color data in a multi-dimensional 

color space; 

means for specifying one or more preferred color locations in the 
color space as one or more color magnets, wherein each color magnet has a 
predetermined region of influence and a particular activity that affects color 
locations in the color space within its region of influence; 

a processor for (a) calculating color space distance between one or 
more color locations of the digital color data in the color space and one or more of 
the color magnets and (b) mapping the digital color data to new locations in the 
multi-dimensional color space as a function of the color space distance and the 
activity, wherein the degree or strength of activity is a function of the color space 
distance or direction in color space, thereby transforming the digital color data to 
new color locations where their reproduction is known to be preferred. 

30. The system as claimed in claim 29 wherein said activity 
specified includes at least one activity selected from the group including 
attraction, repulsion, shielding and dragging. 

3 1 . The system as claimed in claim 30 wherein in the activity of 
attraction the color magnet attracts colors to or toward itself. 

32. The system as claimed in claim 30 wherein in the activity 
of repulsion the color magnet repels colors from itself. 



-30- 

33. The system as claimed in claim 30 wherein in the activity 
of shielding the color magnet shields nearby colors from the effects of other color 
magnets. 

34. The system as claimed in claim 30 wherein in the activity 
of dragging the color magnet itself moves in the color space, dragging nearby 
colors along with it in a prescribed and smoothly varying manner. 
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ABSTRACT 

A file of digital color data representing a color image is 
transformed into a new file of digital color data where one or more colors have 
been transformed to one or more new color locations where their reproduction is 
known to be preferred. The digital color data is provided in a multi-dimensional 
color space where the color locations to be operated on in the color space are 
designated as color magnets. The color space distance is then calculated between 
the color locations of the digital color data in the color space and the color 
magnets. A particular activity is prescribed for each color magnet that affects 
nearby color locations in the color space; this activity includes one or more 
activity selected from the group including attraction, repulsion, shielding and 
dragging. Then, the digital color data is mapped to new locations in the multi- 
dimensional color space as a function of the color space distance and the selected 
activity, wherein the degree or strength of activity is a function of the color space 
distance or direction in color space. 
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Figure 4a. An example of the effect of an attractive magnet that affects hue and lightness shown on an b* 
versus a* diagram. The colors are indicated by stars before application of the color magnets algorithm and 
by triangles after application of the color magnets algorithm. 



Figure 4b. An example of the effect of an attractive magnet that affects hue and lightness shown on an L* 
versus C* diagram. The colors are mdicated by stars before application of the color magnets algorithm and 
by triangles after application of the color magnets algorithm. 



Figure 5 a. An example of the effect of a repulsive magnet that affects hue and lightness of green colors 
having mid-levels of lightness shown on an b* versus a* diagram. The colors are indicated by stars before 
application of the color magnets algorithm and by triangles after application of the color magnets 
algorithm. 
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Figure 5b. An example of tfc 
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algorithm. 
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Figure 6a. An example of the effect of a dragnet that changes green colors by increasing chroma and 
lightness by 10 and decreasing hue angle by 20, shown on an b* versus a* diagram. The colors are 
indicated by stars before application of the color magnets algorithm and by triangles after application 
color magnets algorithm. 



Figure 6b. An example of the effect of a dragnet that changes green colors by increasing chroma and 
lightness by 10 and decreasing hue angle by 20, shown on an L* versus C* diagram. The colors are 
indicated by stars before application of the color magnets algorithm and by triangles after application of the 
color magnets algorithm. 




Figure 7a. An example of the effect of a shield that protects skin colors (L* « 50, a* «25, b* «25) acting on 
an a magnet that modifies chroma and lightness of all hues, shown on an b* versus a* diagram. The colors 
are indicated by stars before application of the color magnets algorithm and by triangles after application of 
the color magnets algorithm. 




Figure 7b. An example of the effect of a shield that protects skin colors (L* « 50, a* «25, b* «25) acting on 
an a magnet that modifies chroma and lightness of all hues, shown on an L* versus C* diagram. The colors 
are indicated by stars before application of the color magnets algorithm and by triangles after application of 
the color magnets algorithm. 
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